Apparatus and method for providing haptic feedback to input unit

ABSTRACT

Methods and apparatus for providing feedback in a portable apparatus are provided. An object is displayed on a touch screen of the portable apparatus. A first touch, from an input unit, is detected at a position on the touch screen corresponding to the displayed object. The object is selected in response to the first touch. A copy command by which the selected object is copied to a copy target is received from the input unit. A first control command corresponding to haptic feedback determined in response to the received copy command is transmitted from the portable apparatus to the input unit.

PRIORITY

This application claims the priority under 35 U.S.C. §119(a) to KoreanApplication Serial No. 10-2013-0022387, which was filed in the KoreanIntellectual Property Office on Feb. 28, 2013, the entire content ofwhich is incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally to a portable apparatus and amethod for providing haptic feedback to an input unit, and moreparticularly, to a portable apparatus and a method for providing hapticand/or auditory feedback from an input unit through a touch interactiongenerated between the input unit and a portable apparatus.

2. Description of the Related Art

The number of services and functions provided by portable apparatuses iscontinually increasing. Various applications that are executable inportable apparatuses are being developed to increase the usability ofthe portable apparatuses and to satisfy various demands of users.

Accordingly, one or more applications may be stored in portableapparatuses, such as, for example, smart phones, mobile phones, notebookPersonal Computers (PCs), and tablet PCs, which can be carried by usersand include touch screens. Shortcut icons for executing the storedapplications are displayed on the touch screens of the portableapparatuses. Thus, a user can select (for example, by a touch) any oneof the shortcut icons displayed on the touch screen to execute a desiredapplication in a portable apparatus. Various types of objects such as,for example, widgets, pictures, videos, or documents, as well asshortcut icons are displayed on the touch screen of the portableapparatus.

The portable apparatus provides a touch input method using an inputunit, such as, for example, a finger of the user, a stylus or anelectronic pen, to select the displayed objects. Further, the touchinput unit includes a non-contact input method such as hovering.

When a touch input by a user occurs on a touch screen, vibrations aregenerated through vibration elements in the portable apparatus so that auser is provided with a feeling as if a button is physically pressed.

SUMMARY OF THE INVENTION

The present invention has been made to address at least the aboveproblems and/or disadvantages and to provide at least the advantagesdescribed below. Accordingly, an aspect of the present inventionprovides a portable apparatus and a method for outputting haptic and/orauditory feedback from an input unit through a touch interactiongenerated between the input unit and a portable apparatus.

Another aspect of the present invention provides a portable apparatusand a method for providing control information corresponding to hapticand/or auditory feedback output from an input unit through a touchinteraction for a copy-and-paste generated between the input unit andthe portable apparatus.

Another aspect of the present invention provides a portable apparatusand a method for providing control information corresponding to hapticfeedback output from an input unit to a user, and auditory feedbackprovided selectively in response to a copy command and a paste commandreceived by the input unit between the input unit and the portableapparatus.

Another aspect of the present invention provides a portable apparatusand a method for providing visual feedback to a touch screen of theportable apparatus in response to a copy command and a paste commandgenerated by an input unit between the input unit and the portableapparatus.

Another aspect of the present invention provides a portable apparatusand a method for providing haptic and auditory feedbacks from theportable apparatus in response to a copy command and a paste commandgenerated by an input unit between the input unit and the portableapparatus.

In accordance with an aspect of the present invention, a feedbackproviding method of a portable apparatus is provided. An object isdisplayed on a touch screen of the portable apparatus. A first touch,from an input unit, is detected at a position on the touch screencorresponding to the displayed object. The object is selected inresponse to the first touch. A copy command by which the selected objectis copied to a copy target is received from the input unit. A firstcontrol command corresponding to haptic feedback determined in responseto the received copy command is transmitted from the portable apparatusto the input unit.

In accordance with another aspect of the present invention, a portableapparatus is provided that includes a touch screen that displays anobject, a communication unit that communicates with an input unit, and acontroller that controls the touch screen and the communication unit.The controller performs a control to select the object in response to afirst touch, from the input unit, at a position on the touch screencorresponding to the displayed object, and to transmit a first controlsignal to the input unit through the communication unit. The firstcontrol signal corresponds to haptic feedback determined in response toa copy command for copying the object received from the input unit to acopy target.

In accordance with another aspect of the present invention, a feedbackcontrol method of an input unit is provided. A copy command, for copyingan object selected from a touch screen of the portable apparatus, istransmitted from the input unit to the portable apparatus. A firstcontrol signal corresponding to the copy command is received from theportable apparatus. Haptic feedback corresponding to the received firstcontrol signal is output through a pen vibrating element of the inputunit.

In accordance with another aspect of the present invention, an inputunit is provided that includes a pen vibrating element, a pencommunication unit that communicates with a portable apparatus, and acontroller that controls the pen vibrating element and the pencommunication unit. The controller performs a control to transmit a copycommand for copying an object selected from a touch screen of theportable apparatus to the portable apparatus through the pencommunication unit, and to output haptic feedback corresponding to afirst control signal received from the portable apparatus through thepen communication unit, through the pen vibrating element.

Another aspect of the present disclosure provides a computer programcomprising instructions arranged, when executed, to implement a methodin accordance with any one of the above-described aspects. A furtheraspect provides machine-readable storage storing such a program.

Various respective aspects and features of the present disclosure aredefined in the appended claims.

It is an aim of certain embodiments of the present disclosure to solve,mitigate or obviate, at least partly, at least one of the problemsand/or disadvantages associated with the prior art. Certain embodimentsaim to provide at least one of the advantages described below.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of the presentinvention will be more apparent from the following detailed descriptionwhen taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram illustrating a portable apparatus, accordingto an embodiment of the present invention;

FIG. 2 is a diagram illustrating a front perspective view of theportable apparatus, according to an embodiment of the present invention;

FIG. 3 is a diagram illustrating a rear perspective view of the portableapparatus, according to an embodiment of the present invention;

FIG. 4 is a diagram illustrating a sectional view of an interior of atouch screen, according to an embodiment of the present invention;

FIG. 5 is a block diagram illustrating an input unit, according to anembodiment of the present invention;

FIG. 6 is a flowchart illustrating a feedback providing method of aportable apparatus, according to an embodiment of the present invention;

FIGS. 7A to 7I illustrate feedback providing methods of a portableapparatus, according to various embodiments of the present invention;

FIG. 8 show an example of haptic waveforms of a portable apparatus,according to an embodiment of the present invention;

FIG. 9 is a flowchart illustrating a feedback providing method of aportable apparatus, according to an embodiment of the present invention;

FIGS. 10A to 10G illustrate feedback providing methods of a portableapparatus, according to various embodiments of the present invention;

FIG. 11 show an example of haptic waveforms of a portable apparatus,according to an embodiment of the present invention;

FIG. 12 is a diagram illustrating a feedback providing method of aportable apparatus, according to an embodiment of the present invention;and

FIGS. 13 to 15 show examples of haptic waveforms of a portableapparatus, according to embodiments of the present invention.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE PRESENT INVENTION

Embodiments of the present invention are described in detail withreference to he accompanying drawings. The same or similar componentsmay be designated by the same or similar reference numerals althoughthey are illustrated in different drawings. Detailed descriptions ofconstructions or processes known in the art may be omitted to avoidobscuring the subject matter of the present invention.

The terms including ordinal numbers, such as first and second, may beused to describe various constituent elements, but the elements are notlimited by the terms. The terms are used only to distinguish one elementfrom other elements. For example, a first element may be named a secondelement without departing from the scope of the present invention, and asecond element may be named a first element similarly. The term and/orincludes a combination of a plurality of items or any one of a pluralityof items.

The terms herein are used only to describe specific embodiments of thepresent invention, and are not intended to limit the present invention.A singular expression includes a plural expression unless differentlydefined explicitly in the context. In particular, where the indefinitearticle is used, the specification is to be understood as contemplatingplurality as well as singularity, unless the context requires otherwise.

In addition, since terms, such as “including,” “comprising,” and“having” mean that one or more corresponding components may exist unlessthey are specifically described to the contrary, it shall be construedthat one or more other components can be included. Furthermore,throughout the description and claims of this specification, the words“comprise” and “contain” and variations of the words, for example“comprising” and “comprises”, mean “including but not limited to”, andare not intended to (and do not) exclude other components, integers orsteps.

FIG. 1 is a block diagram illustrating a portable apparatus, accordingto an embodiment of the present invention.

Referring to FIG. 1, a portable apparatus 100 may be connected to anexternal apparatus by using a mobile communication unit 120, asub-communication unit 130, and/or a connector 165. The externalapparatus may be another portable apparatus, a mobile phone, a smartphone, an input unit, a tablet PC, or a server. The portable apparatus100 is an apparatus that can be carried and that can transmit andreceive data, and may include at least one touch screen. The portableapparatus may be embodied as a mobile phone, a smart phone, a tablet PC,a 3-Dimensional Television (3D-TV), a smart TV, a Light Emitting Diode(LED) TV, and a Liquid Crystal Display (LCD) TV, and also includes anapparatus which can transmit and receive data to and from a peripheralapparatus or another remotely located apparatus.

The portable apparatus 100 includes a touch screen 190 and a touchscreen controller 195. The portable apparatus 100 also includes acontroller 110, the mobile communication unit 120, the sub-communicationunit 130, a multimedia unit 140, a camera unit 150, a Global PositioningSystem (GPS) unit 155, an input/output module 160, a sensor unit 170, astorage 175, and a power supply 180. The sub-communication unit 130includes at least one of a Wireless Local Area Network (WLAN) moduleunit 131 and a short-range communication unit 132. The multimedia unit140 includes at least one of a broadcasting communication unit 141, anaudio reproduction unit 142, and a video reproduction unit 143. Thecamera unit 150 includes at least one of a first camera 151, a secondcamera 152, and a flash 153. The input/output module 160 includes atleast one of a button 161, a microphone 162, a speaker 163, a vibrationmotor 164, the connector 165, a keypad 166, and an input unit 167. Thesensor unit 170 includes a proximity sensor 171 and a luminance sensor172.

The controller 110 includes an Application Processor (AP) or CentralProcessing Unit (CPU) 111, a Read Only Memory (ROM) 112 for storing acontrol program for control of the portable apparatus 100, and a RandomAccess Memory (RAM) 113 for storing a signal or data input from theoutside of the portable apparatus 100 or used as a memory area for anoperation performed by the portable apparatus 100.

The controller 110 performs functions of controlling an overalloperation of the portable apparatus 100 and a signal flow betweeninternal elements 120 to 195 of the portable apparatus 100, and ofprocessing data. The controller 110 performs a control to supplyelectric power from the power supply 180 to the internal elements 120 to195. The controller 190 executes an Operating System (OS) and anapplication stored in the storage 175.

The CPU 111 may include a Graphic Processing Unit (GPU) for processinggraphics. A core and a GPU of the CPU 111 may constitute a System onChip (SoC). The CPU 111 may include a single core, a dual core, a triplecore, a quad core, or an integer times core. The CPU 111, the ROM 112,and the RAM 113 may be connected to each other through an internal bus.

The controller 110 may control the mobile communication unit 120, thesub-communication unit 130, the multimedia unit 140, the camera unit150, the GPS unit 155, the input/output unit 160, the sensor unit 170,the storage 175, the power supply 180, the touch screen 190, and thetouch screen controller 195.

The controller 110, according to an embodiment of the present invention,may perform a control to display at least one object on the touchscreen, detect a first touch by the input unit from the touch screen,receive a copy command for copying the object determined by the firsttouch to a copy target from the input unit in response to the firsttouch, and transmit a first control command, corresponding to hapticfeedback determined in response to the received copy command, to theinput unit.

The controller 110 may perform a control to display visual feedbackcorresponding to the copy command on the touch screen, and provide thevisual feedback in at least one of a selected object and a new object.

The controller 110 may perform a control to display visual feedback bywhich a current size of the selected object is transitioned to apredetermined size at a constant speed, and is moved to a location wherea touch of the input unit is detected on the touch screen.

The controller 110 may perform a control to display visual feedback bywhich a liquid is suctioned by a pipette, which is a new object.

The controller 110 may perform a control to transmit copy informationcorresponding to the copy command of the input unit to one of the inputunit and an external server.

The controller 110 may perform a control to receive device informationof the input unit from the input unit, and transmit the copy informationto one of the input unit and the external server based on the receiveddevice information.

The controller 110 may perform a control to display, on the touchscreen, a selectable copy icon corresponding to execution of a copy by aselected object in response to a touch gesture of the input unit.

The controller 110 may perform a control to detect a second touch of theinput unit from the touch screen, receive, from the input unit, a pastecommand for pasting the copied object at a paste location where theobject copied in response to the second touch is to be pasted, transmit,to the input unit, a second control command corresponding to hapticfeedback determined in response to the received paste command, anddisplay the copied object at the paste location.

The controller 110 may perform a control to display visual feedbackcorresponding to the paste command on the touch screen.

The controller 110 may perform a control to display visual feedback bywhich a size of the object is transitioned to an original size, beforethe object was copied to the touch screen, at a constant speed, and ismoved to a selected paste location.

The controller 110 may perform a control to display visual feedback bywhich a liquid is discharged from a pipette, which is a new object onthe touch screen.

The controller 110 may perform a control to receive copy informationcorresponding to the paste command from at least one of the input unitand the external server through a communication unit.

The controller 110 may perform a control to display a selectable pasteicon corresponding to execution of a paste of an object, which is to becopied, in response to a touch gesture of the input unit, on the touchscreen.

The mobile communication unit 120 connects the portable apparatus 100 toan external apparatus through a mobile communication by using one or aplurality of antennas under the control of the controller. The mobilecommunication unit 120 transmits and receives a wireless signal for avoice communication, a video communication, a Short Message Service(SMS), a Multimedia Message Service (MMS), and a data communication toand from a mobile phone, a smart phone, a tablet PC, or another portableapparatus, which has a phone number input to the portable apparatus 100.

The sub-communication unit 130 may include only the WLAN module unit131, only the short-range communication unit 132, or both the WLANmodule unit 131 and the short-range communication unit 132.

The WLAN module unit 131 may be connected to the Internet by usingwireless communications at a place where an Access Point (AP) isinstalled under the control of the controller. The WLAN module unit 131supports a WLAN standard (IEEE802.11x) of Institute of Electrical andElectronics Engineers (IEEE). The short-range communication unit 132 maywirelessly perform a short-range communication between the portableapparatus 100 and the external apparatus under the control of thecontroller. The short-range communication may include Bluetooth,Infrared Data Association (IrDA), and Near Field Communication (NFC).

The portable apparatus 100 may include at least one of the mobilecommunication unit 120, the wireless LAN unit 131, and the short-rangecommunication unit 132, according to performance. For example, theportable apparatus 100 may include a combination of the mobilecommunication unit 120, the wireless LAN unit 131, and the short-rangecommunication unit 132.

In an embodiment of the present invention, the term “communication unit”includes the mobile communication unit 120 and the sub-communicationunit 130. According to an embodiment of the present invention, thecommunication unit may receive device information of the input unit 167from the input unit 167 under the control of the controller.

The communication unit may transmit control information corresponding toa copy command of the input unit 167, to the input unit 167, under thecontrol of the controller. The communication unit may transmit copyinformation corresponding to a copy command of the input unit 167, tothe input unit 167 or the external server, under the control of thecontroller.

The communication unit may transmit control information corresponding toa paste command of the input unit 167, to the input unit 167, under thecontrol of the controller. The communication unit may receive copyinformation corresponding to a paste command of the input unit 167, fromthe input unit 167 or the external server, under the control of thecontroller.

The broadcasting communication unit 141 may receive a broadcastingsignal (for example, a TV broadcasting signal, a radio broadcastingsignal, or a data broadcasting signal) transmitted from an externalbroadcasting station and broadcasting added information (for example,Electric Program Guide (EPG) or Electric Service Guide (ESG)) through abroadcasting communication antenna, and may reproduce the broadcastingsignal and the broadcasting added information by using a touch screen, avideo codec unit, and an audio codec unit under the control of thecontroller.

The audio reproduction unit 142 may reproduce an audio source (forexample, an audio file whose file extension is mp3, wma, ogg, or way),stored in the storage 175 of the portable apparatus 100 or received fromoutside of the portable apparatus 100, by using an audio codec unitunder the control of the controller.

According to an embodiment of the present invention, the audioreproduction unit 142 may reproduce auditory feedback (for example,output of an audio source corresponding to a command stored in thestorage in advance), corresponding to a copy command of the input unit167, by using an audio codec unit under the control of the controller.The audio reproduction unit 142 may reproduce an auditory feedback,corresponding to a paste command of the input unit 167, by using anaudio codec unit under the control of the controller.

The video reproduction unit 143 may reproduce a digital video file (forexample, a file whose file extension is mpeg, mpg, mp4, avi, mov, ormkv), stored in the storage 175 of the portable apparatus 100 orreceived from the outside of the portable apparatus 100, by using avideo codec unit under the control of the controller. Most of theapplications that can be installed in the portable apparatus 100 mayreproduce audio and video by using an audio codec unit or a video codecunit.

According to an embodiment of the present invention, the videoreproduction unit 142 may reproduce visual feedback, corresponding to acopy command of the input unit 167, by using a video codec unit underthe control of the controller. The video reproduction unit 142 mayreproduce visual feedback, corresponding to a paste command of the inputunit 167, by using a video codec unit under the control of thecontroller.

It will be easily understood by those skilled in the art that many typesof video and audio codec units are produced and circulated. The videoreproduction unit 143 may reproduce an audio source by using a videocodec unit and an audio codec unit.

The multimedia unit 140 may include the audio reproduction unit 142 andthe video reproduction unit 143, and not the broadcasting communicationunit 141. The audio reproduction unit 142 or the video reproduction unit143 of the multimedia unit 140 may be included in the controller 100. Inan embodiment of the present invention, the term “video codec unit”includes one or more video codec units. In an embodiment of the presentinvention, the term “audio codec unit” includes one or more audio codecunits.

The camera unit 150 may include at least one of the first camera 151 ona front surface 100 a and the second camera 152 on a rear surface 100 c,for photographing a still image or a video under the control of thecontroller. The camera unit 150 may include one or both of the firstcamera 151 and the second camera 152. The first camera 151 or the secondcamera 152 may include an auxiliary light source (for example, the flash153) for providing an amount of light necessary for photographing.

The first camera 151 and the second camera 152 may be located adjacentto an additional camera to capture a 3D image or a 3D video under thecontrol of the controller of the camera unit 150.

The GPS unit 155 periodically receives electromagnetic waves(specifically radio signals including, for example, accurate locationinformation and time information) from a plurality of GPS satelliteslocated in the orbits of the Earth. The portable apparatus 100 mayrecognize a location, a speed, and a time of the portable apparatus 100by using electromagnetic waves received from the plurality of GPSsatellites.

The buttons 161 include a menu button 161 a, a home button 161 b, and aback button 161 c located at a lower portion of the front surface 100 a.The buttons 161 may include a power/lock button 161 d on a lateralsurface 100 b and at least one volume button 161 e. The buttons 161 mayinclude only the home button 161 a. The buttons 161 may be realized by atouch button instead of a physical button. The buttons 161 may bedisplayed on the touch screen 190.

The microphone 162 receives a voice or a sound from the outside togenerate an electrical signal under the control of the controller. Theelectrical signal generated by the microphone 162 is converted by theaudio codec unit to be stored in the storage 175 or output through thespeaker 163. The microphone 162 may be located at one or more of thefront surface 100 a, the lateral surface 100 b, and the rear surface 100c of the portable apparatus 100. At least one microphone may be locatedonly at the lateral surface 100 b.

The speaker 163 may output sounds corresponding to various signals (forexample, a wireless signal, a broadcasting signal, an audio source, avideo file, or photographing of a picture) of the mobile communicationunit 120, the sub-communication unit 130, the multimedia unit 140, orthe camera unit 150 to the outside of the portable apparatus 100 byusing an audio codec unit under the control of the controller.

The speaker 163 may output a sound (for example, a button manipulationsound corresponding to a phone call or a voice communication connectionsound) corresponding to a function performed by the portable apparatus100. At least one speaker 163 may be located on the front surface 100 a,the lateral surface 100 b, and the rear surface 100 c of the portableapparatus 100. As shown in FIGS. 2 and 3, a plurality of speakers 163 aand 163 b are located on the front surface 100 a and the rear surface100 c. A plurality of speakers 163 a and 163 b may be located on thefront surface 100 a or one speaker 163 a may be located on the frontsurface 100 a and a plurality of speakers (not shown) may be located onthe rear surface 100 c.

At least one speaker may be located on the lateral surface 100 b. Theportable apparatus 100 in which at least one speaker is located on thelateral surface 100 b may provide a sound output effect which isdifferent from that of the case in which a speaker is located on thefront surface 100 a and the rear surface 100 c.

According to an embodiment of the present invention, the speaker 163 mayoutput auditory feedback corresponding to a copy command of the inputunit 167 under the control of the controller. The speaker 163 may outputauditory feedback corresponding to a paste command of the input unit 167under the control of the controller.

The vibration motor 164 may convert an electrical signal into mechanicalvibrations under the control of the controller. For example, thevibration motor 164 may include a linear vibration motor, a bar typevibration motor, a coin type vibration motor, or a piezoelectric elementvibration motor. When a request for a voice communication is receivedfrom another portable apparatus, the vibration motor 164 is operated inthe portable apparatus 100 in a vibration mode. One or a plurality ofvibration motors 164 may be located in the portable apparatus 100. Thevibration motor 164 may vibrate the entire portable apparatus 100 orvibrate only a portion of the portable apparatus 100.

According to an embodiment of the present invention, the vibration motor164 may output haptic feedback corresponding to a copy command of theinput unit 167 under the control of the controller. The vibration motor164 may output haptic feedback corresponding to a paste command of theinput unit 167 under the control of the controller. The vibration motor164 may provide various haptic feedback (for example, a vibrationintensity and a vibration time period) based on a control command to thecontroller.

The connector 165 may be used as an interface for connecting theportable apparatus 100 to an external apparatus or a power source. Datastored in the storage 175 of the portable apparatus 100 may betransmitted from the external apparatus or data may be received from theexternal apparatus through a wired cable connected to the connector 165under the control of the controller. Electric power may be input fromthe power source or a battery may be charged through a wired cableconnected to the connector 165.

The keypad 166 may receive a key input from a user to control theportable apparatus 100. The keypad 166 includes a physical keypad formedin the portable apparatus 100 or a virtual keypad displayed on the touchscreen 190. The physical keypad formed in the portable apparatus 100 maybe excluded according to a performance or structure of the portableapparatus 100.

The input unit 167 may touch or select at least one object (for example,a menu, text, an image, a figure, and an icon) displayed on the touchscreen 190 of the portable apparatus 100. The input unit 167 may input acharacter by touching a capacitive, resistive, or electromagneticallyinductive touch screen or by using a virtual keyboard. For example, theinput unit 167 includes a stylus or a haptic pen in which an embeddedpen vibrating element 544 (for example, a vibration motor or anactuator) vibrates by using control information received from acommunication unit of the portable apparatus 100. The vibration elementmay vibrate by using sensing information detected by a sensor (forexample, an acceleration sensor) embedded in the haptic pen 167 insteadof using control information received from the portable apparatus 100.The input unit will be described in greater detail below with referenceto FIGS. 4 and 5.

The sensor unit 170 includes at least one sensor for detecting a stateof the portable apparatus 100. For example, the sensor unit 170 mayinclude the proximity sensor 171 located on the front surface 100 a ofthe portable apparatus 100, a luminance sensor 172 for detecting anamount of light around the portable apparatus 100, an accelerationsensor for detecting inclinations of three axes (for example, thex-axis, the y-axis, and the z-axis) applied to the portable apparatus100, a gyro sensor for detecting a direction of the portable apparatus100 by using momentum, a gravity sensor for detecting a direction ofgravity, or an altimeter for measuring the atmospheric pressure todetect an altitude of the portable apparatus 100. The sensor unit 170may measure an acceleration obtained by adding a kinetic acceleration ofthe portable apparatus and an acceleration of gravity, and may measureonly the acceleration of gravity when the portable apparatus 170 is notmoved. For example, when the front surface of the portable apparatus 100faces upward, the gravitational acceleration may be a positive value,and when the rear surface of the portable apparatus 100 faces upward,the gravitational acceleration may be a negative value.

At least one sensor included in the sensor unit 170 generates a signalcorresponding to the detection to transmit the signal to the controller.The sensors of the sensor unit 170 may be added or deleted according toa performance of the portable apparatus 100.

The storage unit 175 may store a signal or data that is input or outputto correspond to operations of the mobile communication unit 120, thesub-communication unit 130, the multimedia unit 140, the camera unit150, the GPS unit 155, the input/output unit 160, the sensor unit 170,and the touch screen 190 under the control of the controller. Thestorage 175 may store a control program for control of the portableapparatus 100 or the controller, GUIs related to applications providedby the manufacturer or downloaded from the outside, images for providingthe GUIs, user information, documents, databases, or related data.

The storage 175, according to an embodiment of the present invention,may store device information, a copy command, and a paste commandreceived from the input unit 167. The storage unit 175 may store firsttouch information (for example, the X and Y coordinates of a touch, atouch time, and the like) corresponding to a first touch input from theinput unit 167 or first hovering information (for example, the X, Y, andZ coordinates of hovering, a hovering time, and the like) correspondingto a first hovering. The storage 175 may store visual feedbackrecognizable by the user and displayed on the touch screen 190 tocorrespond to a copy command received by the input unit 167, auditoryfeedback output to the speaker 163, and haptic feedback output by thevibration motor 164. The storage unit 175 may store second touchinformation corresponding to a second touch input from the input unit167 or second hovering information corresponding to a second hovering.The storage 175 may store visual feedback recognizable by the user anddisplayed on the touch screen 190 to correspond to a paste commandreceived by the input unit 167, auditory feedback output to the speaker163, and haptic feedback output by the vibration motor 164.

In an embodiment of the present invention, the term “storage” includesthe storage 175, the ROM 112, and the RAM 113 included in thecontroller, and a memory card (for example, a micro SD card and a memorystick) mounted to the portable apparatus 100. The storage may include anonvolatile memory, a volatile memory, a Hard Disk Drive (HDD), or aSolid State Memory (SSM).

The power supply 180 may supply electric power to one or a plurality ofbatteries located in the portable apparatus 100 under the control of thecontroller. The one or plurality of batteries may be located between thetouch screen located on the front surface 110 a and the rear surface 110c. The power supply 180 may supply electric power input from an externalpower source through a wired cable connected to the connector 165 of theportable apparatus 100.

The touch screen 190 may provide GUIs corresponding to various services(for example, voice communication, data transmission, broadcasting,photographing a picture or a video, or an application) to the user. Thetouch screen 190 transmits an analog signal corresponding to one or moretouches input through the GUIs to the touch screen controller 195. Thetouch screen 190 may receive one or more touches through a finger of theuser or the input unit 167.

In an embodiment of the present invention, a touch is not limited to acontact of a body of the user or a touchable input unit 167 with thetouch screen 190, and may include hovering in which a detectableinterval between the touch screen 190 and the finger of the user or theinput unit 167 is 30 mm or less. The non-contact interval detectable bythe touch screen 190 may be changed according to a performance orstructure of the portable apparatus 100.

The touch screen 190 may be realized, for example, by a resistive touchscreen, a capacitive touch screen, an infrared touch screen, or anacoustic wave touch screen. The touch screen 190 will be described ingreater detail below with reference to FIG. 4.

According to an embodiment of the present invention, the touch screen190 may output visual feedback corresponding to a copy command of theinput unit 167 under the control of the controller. The touch screen 190may output haptic feedback corresponding to a paste command of the inputunit 167 under the control of the controller.

The touch screen controller 195 may convert an analog signalcorresponding to one or more touches received by the touch screen 190into a digital signal (for example, the X and Y coordinatescorresponding to the touch location) to transmit the digital signal tothe controller. The controller 110 may calculate the X and Y coordinatescorresponding to the touch location on the touch screen by using adigital signal received from the touch screen controller 195. Thecontroller 110 may control the touch screen 190 by using a digitalsignal received from the touch screen controller 195. The controller 110may execute an application corresponding to a displayed or selectedshortcut icon in response to the input touch.

According to an embodiment of the present invention, one touch screencontroller 195 may control the touch screen 190. The touch screencontroller 195 may be included in the controller 110 based on aperformance or structure of the portable apparatus 100. The touch screencontroller 195 is described in greater detail below with reference toFIG. 4.

At least one of the elements shown in the portable apparatus 100 of FIG.1 may be added or deleted based on a performance of the portableapparatus 100. It will be understood by those skilled in the art thatlocations of the elements can be changed based on a performance orstructure of the portable apparatus 100.

FIG. 2 is a diagram illustrating a front perspective view of theportable apparatus, according to an embodiment of the present invention.

FIG. 3 is a diagram illustrating a rear perspective view of the portableapparatus, according to an embodiment of the present invention.

Referring to FIGS. 2 and 3, the touch screen 190 is located at a centralportion of the front surface 100 a of the portable apparatus 100. FIG. 2shows an example of a home screen on the touch screen 190 when the userlogs into the portable apparatus 100. The portable apparatus 100 mayhave a plurality of different home screens. Shortcut icons 191 a, 191 b,and 191 c for executing frequently used applications, a menu switchingkey 191 d displaying a menu screen, a time, and the weather aredisplayed on the home screen 191. A status bar 192 for displaying astate of the portable apparatus 100, such as, for example, a batterycharging status, an intensity of a received signal, and a current time,are displayed at an upper end of the home screen 191. The status bar 192may not be displayed on the home screen 191 of the portable apparatus100 according to an Operating System (OS).

The home button 161 a, the menu button 161 b, and the back button 161 care located at a lower portion of the front surface 100 a of theportable apparatus 100. The buttons 161 may be realized by a touchbutton instead of a physical button. The buttons 161 may be displayed onthe touch screen 190.

The first camera 151, the proximity sensor 171, and the luminance sensor172 are located at an upper portion of the front surface 100 a of theportable apparatus 100. The second camera 152, the flash 153, and thespeaker 163 are located on the rear surface 100 c of the portableterminal 100.

For example, the power/lock button 161 d, the volume button 161 e, andthe one or more microphones 162 are located on the lateral surface 100 bof the portable apparatus 100.

The connector 165 is formed on the lateral surface 100 b of a lower endof the portable apparatus 100. The connector 165 may have a plurality ofelectrodes and may be wiredly connected to an external apparatus. Theinput unit 167 is located on the lateral surface 100 b of a lower end ofthe portable apparatus 100. The input unit 167 may be inserted into andkept in the portable apparatus 100, and may be extracted from theportable apparatus 100 during use thereof.

FIG. 4 is a diagram illustrating a sectional view of an interior of atouch screen, according to an embodiment of the present invention.

Referring to FIG. 4, the touch screen 190 is configured such that afirst touch panel 190 a for detecting a touch input of a finger or theinput unit 167, a display panel 190 b for displaying a screen, and asecond touch panel 191 for detecting an input of the input unit 167, aresequentially stacked. According to an embodiment of the presentinvention, the first touch panel 190 a of the touch screen 190 may belocated below the display panel 190 b.

The first touch panel 190 a is a capacitive touch panel, and is obtainedby coating a thin metallic conductive material (for example, an IndiumTin Oxide (ITO) film) on opposite surfaces of glass, such that a currentflows along surfaces of the glass, and coated with a dielectric materialcapable of storing electric charges. When a finger of the user or theinput unit 167 touches a surface of the first touch panel 190 a, apredetermined amount of electric charges are moved by staticelectricity, and the first touch panel 190 a recognizes a change in acurrent due to movement of electric charges to detect a touch location.

The display panel 190 b includes a plurality of pixels, and displays animage through the pixels. For example, the display panel 190 b may beembodied as an LCD), an Organic Light Emitting Diode (OLED), or an LED.The display panel 190 b displays various images and a plurality ofobjects according to various operation states of the portable apparatus100, and execution of applications and services.

The second touch panel 191 is an Electronic Magnetic Resonance (EMR)type touch panel, and includes an electronic inductive coil sensorhaving a grid structure, such that a plurality of loop coils aredisposed in a first direction and a second direction crossing the firstdirection, and includes an electronic signal processing part forsequentially providing an AC signal having a predetermined frequency tothe loop coils of the electronic inductive coil sensor. When the inputunit 167, having a resonance circuit therein, is located adjacent to aloop coil of the second touch panel 191, the electric field generatedfrom the loop coil generates a current based on electromagneticinduction in a resonance circuit of the input unit 167. An inductivemagnetic field is generated in a coil 530 constituting a resonancecircuit in the input unit 167, and the second touch panel 191 detects aninductive magnetic field from the loop coil in a signal receiving stateto detect a hovering location and a touch location of the input unit167. The portable terminal 100 may detect a hovering height h, betweenthe display panel 100 to a pen tip 541 of the input unit 167.

It will be understood by those skilled in the art that the hoveringheight h can be changed to correspond to a performance or structure ofthe portable terminal 100.

The second touch panel 191 may be dedicatedly used for detection ofhovering or a touch by the input unit 167. The input unit 167 may bereferred to as an electromagnetic pen or an EMR pen. The input unit 167may be different from a general pen which does not have a resonancecircuit detected by the first touch panel 190 a. The input unit 167 mayinclude a button 542 for changing an electromagnetic induction valuegenerated by the coil 530 located in an area adjacent to the pen tip541. The input unit 167 is described in greater detail below withreference to FIG. 5.

The touch screen controller 195 may include a first touch panelcontroller corresponding to the first touch panel 190 a, and a secondtouch panel controller corresponding to the second touch panel 191. Thefirst touch panel controller converts an analog signal received bydetection of a touch of a finger or the input unit 167 from the firsttouch panel 190 a into a digital signal (for example, X and Ycoordinates) to transmit the digital signal to the controller. Thesecond touch panel controller (not shown) converts an analog signalreceived by detection of hovering or a touch of the input unit 167 fromthe second touch panel 191 into a digital signal (for example, X, Y, andZ coordinates) to transmit the digital signal to the controller.

The controller 110 may control the first touch panel 190 a, the displaypanel 190 b, and the second touch panel 191 by using the digital signalsreceived from the first touch panel controller and the second touchpanel controller. The controller 110 may display a screen on the displaypanel 190 b in response to a touch or hovering of a finger or the inputunit 167. One touch screen controller 195 may control the first touchpanel 190 a and the second touch panel 191.

In an embodiment of the present invention, the term “touch screencontroller” includes the touch screen controller 195, the first touchscreen controller, and/or the second touch controller.

Thus, the controller 110 of the portable apparatus 100, according to anembodiment of the present invention, may distinguish and detect a touchand/or hovering by a finger of the user or the input unit 167. AlthoughFIG. 4 shows only one touch screen, the portable apparatus 100,according to an embodiment of the present invention, may include aplurality of touch screens instead of one touch screen. The touchscreens may be located in a housing and may be connected to each otherby a hinge, or a plurality of touch screens may be located in oneflexible housing. As shown in FIG. 4, the plurality of touch screens mayinclude a display panel and at least one touch panel, respectively.

FIG. 5 is a diagram illustrating an input unit, according to anembodiment of the present invention.

Referring to FIG. 5, the input unit 167 may be connected to the portableapparatus 100, another portable apparatus, a mobile phone, a smartphone, a tablet PC, or an external server by using a pen communicationunit 520.

The input unit 167 may include a pen controller 510, the pencommunication unit 520, a coil 530, the pen felt-tip 541, a pen button542, a pen speaker 543, the pen vibrating element 544, a pen memory 550,and a pen battery 560.

The pen controller 510 may control the pen communication unit 520, thecoil 530, the pen felt-tip 541, the pen button 542, the pen speaker 543,the pen vibrating element 544, the pen memory 550, and the pen battery560. The pen controller 510 may perform a function of controlling anoverall operation of the input unit 167 and a signal flow between theinternal elements 520 to 560 of the input unit 167, and a function ofprocessing data. When the pen felt-tip 541 is situated at a locationwhere a contact or hovering can be detected on the touch screen 190 (20mm or less above the touch screen 190), the pen controller 510 mayanalyze first and/or second control signals received from the portableapparatus 100 through the pen communication unit 520, and control avibration period and a vibration intensity of the pen vibrating element544 included in the input unit 167 based on the first and/or secondcontrol signals. The pen controller 510 may control a supply of electricpower from the pen battery 560 to the internal elements 520 to 550.

According to an embodiment of the present invention, when the button 542is pressed by the user after at least one object displayed on theportable apparatus 100 is selected by a touch or hovering of the inputunit 167, the pen controller 510 may perform a control to transmit acopy command for copying the object to a copy target through the pencommunication unit 520. The pen controller 510 may perform a control toreceive some of copy information corresponding to the copy command fromthe portable apparatus 100 through the pen communication unit 520. Thecopy information may include object data corresponding to an object tobe copied, a file name, a file size, a file type, a file storagelocation, and a copy time period. The pen controller 510 may perform acontrol to receive some of copy information corresponding to the copycommand from an external server through the pen communication unit 520.The one or more pen speakers 543 may be located in the housing of theinput unit 167.

The pen communication unit 520 may include one of a WLAN unit and ashort-range communication unit having a frequency band of 2.4 GHz. Thepen communication unit 520 may include both the WLAN unit and theshort-range communication unit. The pen communication unit 520 may beconnected to the portable apparatus 100 and an external server under thecontrol of the pen controller 510.

According to an embodiment of the present invention, the pencommunication unit 520 may be connected to the portable apparatus 100having the short-range communication unit 132 through pairing under thecontrol of the pen controller 510 to transmit and receive a controlsignal and data. The pen communication unit 520 may receive a controlsignal transmitted from the portable apparatus 100 and transfer thecontrol signal to the pen controller 510. The pen communication unit 520may analyze a control signal received from the portable apparatus 100.Although Bluetooth communication is used as an example of a short-rangecommunication unit in an embodiment of the present invention, it may bereplaced by or used together with a short-range communication unit, suchas, for example, Zigbee, an Ultra Wide Band (UWB) communication, or anRFID, by which a communication channel can be formed in a short rangeand a signal can be transmitted and received.

The coil 530 generates an inductive magnetic field through aninteraction with a loop coil of the second touch panel 191 of theportable apparatus 100. The portable apparatus 100 may receive aninductive magnetic field generated by the coil 530 and detect a hoveringlocation and a touch location of the input unit 167. The portableterminal 100 may detect a height h from the touch screen 190 to the penfelt-tip 541 of the input unit 167.

When the pen button 542 is pressed by the user, it may change anelectromagnetic induction value generated in the coil 530. The penbutton 542 may include a physical button or a touch button.

The pen speaker 543 may output various sound sources stored in the penmemory 550 under the control of the controller 510. The pen speaker 543,according to an embodiment of the present invention, may output auditoryfeedback corresponding to a first control command received from theportable apparatus 100 in response to a copy command generated by thebutton 542. The pen speaker 543 may output auditory feedbackcorresponding to a second control command received from the portableapparatus 100 in response to a paste command generated by the button542. The pen speaker 543 may output a sound corresponding to a vibrationperiod and/or a vibration intensity of the pen vibration element 520.The pen speaker 560 may output a sound corresponding to first and/orsecond control signals output to the input unit 167 substantiallytogether with the speaker 163 included in the portable apparatus 100(for example, a time interval of 5 ms or less) or after a predeterminedtime period (for example, 20 ms).

The pen vibrating element 544 may convert an electrical signal intomechanical vibrations under the control of the pen controller 510.

According to an embodiment of the present invention, the pen vibratingelement 544 may be activated based on a first control signal and/or asecond control signal received from the portable apparatus 100, and mayprovide haptic feedback to the user. The pen vibrating element 544 mayvibrate the entire input unit 167 or a portion of the input unit 167.

The pen memory 550 may store a signal or data that is input or output tocorrespond to operations of the pen communication unit 520, the coil530, the pen button 542, the pen speaker 543, the pen vibrating element544, and the pen battery 560, under the control of the pen controller510.

According to an embodiment of the present invention, the pen memory 550may store device information of the input unit 167. For example, theinput information may include a model name, a unique unit ID, a residualsize of a memory, existence of object data, a Bluetooth version, or aBluetooth profile. The pen memory 550 may store one or a plurality ofhaptic waveforms in which the pen vibrating element 544 vibrates basedon first and/or second signals received from the portable apparatus 100.

The pen battery 560 may supply electric power to the elements 510 to 550of the input unit under the control of the pen controller 510. When thebattery level is not sufficient, the pen battery 560 may be rechargedwirelessly or through a separate wired cable.

According to an embodiment of the present invention, a control signal isreceived through the pen communication unit 520 of the input unit 167under the control of the pen controller 510. The control signal is asignal received from the portable apparatus 100, and may be periodicallyreceived by the input unit 167 for a predetermined time period or untila time point when hovering is completed. For example, the control signalincludes information for activating a mode of a vibrating element 544 ofthe input unit 167, information for representing a vibration intensityof the input unit 167, information for deactivating a mode of thevibrating element 544 of the input unit 167, and information forrepresenting a total time for which the pen vibrating element 544vibrates. The control signal has a size of about 8 bytes, and may berepeatedly transmitted by the portable apparatus 100 according to apredetermined period (for example, 5 ms). For example, the controlsignal may include information in Table 1.

TABLE 1 Activation of Vibrating Vibration Deactivation of Field ElementIntensity Vibrating Element Information 1 125 125 131 131 0 2

As in Table 1, a control signal includes information for activating thepen vibrating element 544 of the input unit 167, information forrepresenting a vibration intensity of the pen vibrating element 544, andinformation for deactivating the pen vibrating element 544. The controlsignal may be transmitted to the input unit 167 in units of 5 ms, whichis merely an example, and may be variably transmitted according to aperiod of haptic waveforms. The transmission period and the transmissiontime period of the control signal is also variable. The transmissiontime period may be a period until a time point when hovering iscompletely recognized. It will be easily understood by those skilled inthe art that an intensity of the control signal may be changed tocorrespond to a wireless communication method, a performance, or astructure of the portable apparatus 100 and the input unit 167.

At least one of the elements shown in the input unit 167 of FIG. 5 maybe added or deleted to correspond to a performance of the input unit167. It will be easily understood by those skilled in the art thatlocations of the elements may be changed to correspond to a performanceor structure of the portable apparatus 100.

FIG. 6 is a flowchart illustrating a feedback providing method of aportable apparatus, according to an embodiment of the present invention.

FIGS. 7A to 7I illustrate feedback providing methods of a portableapparatus, according to various embodiments of the present invention.

FIG. 8 shows an example of haptic waveforms of a portable apparatus,according to an embodiment of the present invention.

In step S601 of FIG. 6, one or more objects are displayed in the touchscreen.

Referring to FIG. 7A, a plurality of application screens 710 and 720 aredisplayed on the touch screen 190. An object 711 is displayed on thedisplayed application screen 710. According to an embodiment of thepresent invention, the object 711 may be displayed on the touch screen190 of the portable apparatus 100, and includes at least one of adocument, a widget, a picture, a map, a video, an e-mail, an SMSmessage, and an MMS message, and may be executed, deleted, cancelled,stored, and changed by the input unit 167. The object may be implementedas a shortcut icon, a thumbnail image, or a folder storing at least oneobject in the portable apparatus. For example, the application screen710 is a web browser screen, and the application screen 720 is a noteapplication screen. Further, the executed application screen 710 may bedisplayed in FIG. 7A. In addition, while a plurality of applications areexecuted, the application screen 710 may be displayed and theapplication screen 720 may not be displayed.

An example of an application screen displayed on the touch screen 190will be easily understood by those skilled in the art.

The controller 110 may discover the input unit 167, which can perform aBluetooth communication, by using a communication unit. The controller110 may receive device information (for example, a model name, a uniqueunit ID, a residual size of a memory, a Bluetooth version, or aBluetooth profile) from the input unit 167 through a communication unit.When being connected to the input unit 167, the controller 110 mayperform pairing with the input unit 167 through a communication unit.The controller 110 may perform pairing with the input unit 167 manually(for example, discover the input unit 167 from the portable apparatus100) or automatically (for example, display a pop-up for registration ofan input unit 167 when the input unit 167 is detected from the portableapparatus 100). The controller 110 may receive device information (forexample, a model name, a unique unit ID, a residual size of a memory, aBluetooth version, or a Bluetooth profile) of the input unit 167 throughpairing. The controller may receive device information of the input unit167 after pairing. The received device information is stored in thestorage unit of the portable apparatus 100. The controller 110 mayperform various embodiments of the present invention by using the deviceinformation of the input unit 167. The portable apparatus 100 and theinput unit 167 may communicate with a counterpart device throughpairing, and share a link key, which is to be used in a verificationprocess, to set a mutually encrypted connection, which means that datacan be transmitted mutually.

An example of the device information of the input unit 167 will beeasily understood by those skilled in the art.

In step S602 of FIG. 6, a first touch of an input unit is detected.

Referring to FIG. 7B, the object 711 displayed on the application screen710 is touched by the input unit 167. The controller 110 may detect afirst touch 712 of the input unit 167 from the application screen 710through the touch screen 190, the pen recognition panel 191, and thetouch screen controller 195. The controller 110 may receive firstlocation information (for example, X1 and Y1 coordinates) correspondingto the first touch 712 from the touch screen controller.

The controller 110 may detect hovering 712 a of the input unit 167 fromthe application screen 710 through the pen recognition panel 191 and thetouch screen controller 195. The controller 110 may receive secondlocation information (for example, X2 and Y2 coordinates) correspondingto hovering 712 a detected from the touch screen controller.

The controller 110 may store a touch on the touch screen 190 included inthe received first location information, a hovering location on thetouch screen 190 included in the second location information, a touchdetection time, and touch information (for example, a touch pressure ora hovering height) corresponding to the touch in the storage.

It will be easily understood by those skilled in the art that the numberof detected touches may be changed to correspond to a performance orstructure of the portable apparatus 100.

In step S603 of FIG. 6, an object to be copied is selected.

Referring to FIG. 7C, the controller 110 may select the object 711corresponding to the touch 712 of the input unit 167. The controller mayselect the object 711 corresponding to hovering 712 a of the input unit167. For example, the object 711 may be selected by displaying aperiphery 711 a of the object 711, displaying a separate symbol (forexample, □, ⋄, and ∘) at the periphery 711 a of the object 711, ordisplaying the object 711 in different colors. The controller 110 mayselect the object 711 by using first location information (X1 and Y1coordinates) corresponding to the touch 712 of the input unit 167received from the touch screen controller 195 or second locationinformation (X2 and Y2 coordinates) corresponding to hovering 712 a. Thecontroller 110 maps object information (for example, a file name, a filesize, a file type, a file extension, or a file storage location)corresponding to the selected object 711 with device information of theinput unit 167 stored in advance, to store the mapping result in atemporary storage space in the application 710 or a clip board. Thecontroller 110 may provide at least one of visual feedback (for example,a flash and a video) through the touch screen 190, auditory feedback(for example, output of a sound) using the speaker 163, and hapticfeedback (for example, output of vibrations) using the vibration motor164 to correspond to selection of the object 711.

The controller 110 may perform a control to transmit a first controlsignal corresponding to haptic feedback (for example, output ofvibrations) to be output from the pen vibrating element 544 through acommunication unit, in response to device information of the input unit167 and selection of the object 711, to the input unit 167 in aBluetooth Serial Port Profile (SSP). The input unit 167 may outputhaptic feedback (for example, output of vibrations) from the penvibrating element 544 based on a first control signal received from theportable apparatus 100.

The controller 110 may perform a control to transmit a first controlsignal corresponding to auditory feedback (for example, output of asound) to be output from the pen speaker 543, in response to deviceinformation of the input unit 167 stored in advance and selection of theobject 711, to the input unit 167 in a Bluetooth Serial Port Profile(SSP), separately from the first control signal corresponding to hapticfeedback, through a communication unit. The input unit 167 may outputauditory feedback (for example, output of a sound) from the pen speaker543 based on the first control signal received from the portableapparatus 100. The pen controller 510 may provide one of haptic feedbackand auditory feedback, or a combination of haptic feedback and auditoryfeedback.

The controller 110 may perform a control to transmit one of a firstcontrol signal, where haptic, auditory, or visual feedback provided bythe portable apparatus 100 is the same as haptic, auditory, or visualfeedback provided by the input unit 167, and another control signalthrough a communication unit.

In step S604 of FIG. 6, it is determined whether a copy command, inputvia a button of the input unit, is received.

Referring to FIG. 7D, the controller 110 may receive a copy command forthe selected object 711 from the input unit 167 in a Bluetooth SerialPort Profile (SPP). The controller maps the received copy command withthe device information of the input unit 167 stored in advance andstores the mapping result in the storage.

When the button 542 is pressed 713 by the user, the pen controller 510may convert an operation mode of the input unit 167 into a copy mode. Ifan input of touching the button 542 is generated by the user when thebutton 542 is of a touch type, the pen controller 510 may convert anoperation mode of the input unit 167 into a copy mode. The pencontroller 510 may perform a control to transmit a copy command to theportable apparatus 100 through the pen communication unit 520. The copycommand may be transmitted periodically (for example, every 50 ms) for apredetermined time period (for example, 5 s) through the pencommunication unit 520 under the control of the pen controller 510. Thepredetermined time may be variably regulated. When the button 542 ispressed once more by the user, the pen controller 510 may release thecopy mode, which is a current operation mode of the input unit 167. Whenthe button 542 of the input unit 167 that is hovering is pressed 713 bythe user, the pen controller 510 may convert an operation mode of theinput unit 167 into a copy mode. The pen controller 510 may perform acontrol to transmit a copy command to the portable apparatus 100 throughthe pen communication unit 520 in the Bluetooth Serial Port Profile(SPP). The copy command may be transmitted periodically (for example,every 50 ms) for a predetermined time (for example, 5 s) through the pencommunication unit 520 under the control of the pen controller 510. Whenthe button 542 is pressed 713 once more by the user, the pen controller510 may release the copy mode, which is a current operation mode of theinput unit 167.

When a copy command, input via a button of the input unit 167, isreceived, a visual feedback is displayed on the touch screen and acontrol command corresponding to haptic feedback is transmitted to theinput unit 167, in step S605 of FIG. 6.

Referring to FIGS. 7E and 7G, the controller 110 may perform a controlto display visual feedback 714 by which the object 711 is reduced from acurrent size (for example, 200 pixels×240 pixels) to a predeterminedsize 711 b (for example, 50 pixels×50 pixels, which is 25% of theoriginal size) in response to the received copy command. The visualfeedback 714 is gradually reduces the current size of the object 711 tothe predetermined size 711 b. The visual feedback 714 may reduce theobject 711 to a predetermined size 711 b with reference to a centrallocation of the current size of the object 711. When the visual feedback714 completely reduces the object 711 to the predetermined size 711 band the input unit 167 becomes more distant from the touch screen 190than a height where hovering of the input unit 167 is detected, thecontroller may not display the reduced object 711 b. When the input unit167 is closer to the touch screen 190 than a height where hovering ofthe input unit is detected, the controller may display the reducedobject 711 b.

The controller 110 may perform a control to transmit a first controlsignal to the input unit 167 in a Bluetooth Serial Port Profile (SPP) byusing device information of the input unit 167 stored in advance, inresponse to the received copy command. The first control signal mayinclude haptic information on haptic feedback 715 to be output throughthe pen vibrating element 544. For example, Table 1 is an example ofhaptic information. The first control signal may include auditoryinformation on auditory feedback 716 to be output through the penspeaker 543. The auditory information may include a sound source to beoutput through the pen speaker 543. The input unit 167 may store hapticinformation corresponding to the haptic feedback and auditoryinformation corresponding to the auditory feedback in the pen memory 550in advance. The control information may include a file name, a filetype, the pen speaker 543 activation information, sound intensityinformation, and the pen speaker 543 deactivation informationcorresponding to a sound source stored in the pen memory 550.

The controller may simultaneously perform transmission of a firstcontrol signal to the input unit 167 and displaying of visual feedback,or may perform one of transmission of the first control signal anddisplaying of the visual feedback first.

According to an embodiment of the present invention, additional visualfeedback 714 a using a new object 714 b, as well as visual feedback ofthe object 711, may be selectively provided. Referring to FIG. 7F, whenthe visual feedback 714 is displayed, the new object 714 b is displayedadjacent to (for example, 20 mm or less) the object 711. The new object714 b is an empty pipette that has not suctioned a liquid. Thecontroller may display the pipette 714 b, which gradually suctions aliquid in response to the visual feedback 714 by which the size of theobject 711 is gradually reduced to a predetermined size. When the object711 is completely reduced to a predetermined size 711 b, the controller110 may display a pipette 714 c that has completely suctioned a liquid.The controller 110 may display the pipette 714 c that has completelysuctioned a liquid for a predetermined time period (for example, 500ms).

The controller 110 may perform a control to output haptic feedbackthrough the vibration motor 164 as well as through visual feedback inresponse to the received copy command. The controller 110 may vibratethe vibration motor 164 to correspond to haptic information as shown inFIG. 8 to provide haptic feedback. FIG. 8 is described in greater detailbelow with respect to step S606 of FIG. 6. The controller 110 mayperform a control to output a sound source corresponding to auditoryfeedback through the speaker 163, as well as visual feedback, inresponse to the received copy command.

In step S606 of FIG. 6, the input unit 167 provides haptic feedback andauditory feedback.

Referring to FIGS. 7E and 8, the pen controller 510 may receive acontrol command in a Bluetooth Serial Port Profile (SPP) through the pencommunication unit 520. The pen controller 510 may control such that thepen vibrating element 544 outputs (for example, FIG. 8) haptic feedback,corresponding to haptic information included in control information, inresponse to the received control command.

The transverse axis (X axis) of FIG. 8 represents a vibration timeperiod of the pen vibrating element 544, in units of 50 ms 805 a. Thelongitudinal axis (Y axis) represents a vibration intensity of the penvibrating element 544, in units of 500 mV 805 b. As shown, the hapticwaveform corresponding to the haptic information of FIG. 8 graduallyincreases from 0 V to 1.6 V and rapidly decreases to 0V in thevibration.

In a preprocessing section 810 a, the pen controller 510 may analyzeand/or store control information received by the portable apparatus 100and supply electric power to the pen vibrating element 544. For example,the preprocessing section 810 a may refer to a section before vibrationsare generated in the pen vibrating element 544.

An acceleration section 810 b is a section in which a vibration timeperiod and a vibration intensity of the pen vibrating element 544increase. A maximum intensity 810 d of the acceleration section 810 bmay be changed according to a file size and a copy processing timeperiod included in the copy information. For example, the maximumacceleration section and the maximum intensity of the accelerationsection whose file size is 1 MB may be greater than those of theacceleration section whose file size is 500 KB. The copy processing timeperiod and the maximum intensity of the acceleration section whose copyprocessing time period is 1.5 s may be greater than those of theacceleration section whose copy processing time period is 500 ms.

A deceleration section 810 c is a section in which vibrations of the penvibrating element 544 corresponding to the maximum intensity 810 ddecelerate. The pen controller 510 may complete the output of hapticfeedback in the deceleration section 810 c. The time axis of thedeceleration section 810 c may be shorter than or equal to the time axis(X axis) of the acceleration section 810 b. In an embodiment of thepresent invention, various haptic waveforms (for example, FIGS. 13 to15), whose vibration time periods, vibration periods, and vibrationintensities are different, may be stored in addition to FIG. 8, andanother haptic waveform may be generated and stored by using acombination of the haptic waveforms (for example, FIGS. 13 to 15) thatare stored in advance.

The pen controller 510 may perform a control to output auditory feedbackcorresponding to auditory information (for example, a sound source)included in control information from the pen speaker 543 in response tothe received control command. The pen controller 510 may perform acontrol to selectively output one of haptic feedback and auditoryfeedback.

In step S607 of FIG. 6, it is determined whether a residual size of thememory of the input unit 167 is sufficient.

The controller may compare a residual size of the pen memory 550 of theinput unit 167 with a file size included in object information of theobject 711, by using device information of the input unit 167 stored inadvance.

According to the comparison result, the controller may transmit one ofcopy information including object data of the object 711 and copyinformation excluding object data of the object 711 to the input unit167.

In an embodiment of the present invention, it will be easily understoodby those skilled in the art that the residual size of the memory of theinput unit may be identified in steps S603 to S605.

When the residual size of the memory of the input unit 167 is notsufficient, copy information is transmitted to the input and theexternal server, in step S612.

When the residual size of the pen memory 550 is smaller than a file sizeof the object 711, the controller may perform a control to transmitfirst copy information without object data of the copy informationcorresponding to the object 711 to the pen communication unit 520 byusing device information of the input unit 167. The controller 110 mayperform a control to transmit object data of the copy information to anexternal server through a URL of an external server of a manufacturerstored in the storage and a communication unit. The controller 110 maymap the first copy information with the URL of the external server tostore the mapping result. The controller 110 may receive object datatransmitted to an external server by using the first copy informationtransmitted to the input unit 167. The controller 110 may store objectdata of the copy information in a clip board of the storage. The objectdata stored in the clip board may be pasted in the portable apparatus100 by using the first copy information transmitted to the input unit167.

It will be easily understood by those skilled in the art that in anembodiment of the present invention, a copy command, controlinformation, and copy information are transmitted and received betweenthe portable apparatus 100, the input unit 167, and the external serverby using communication units of the portable apparatus 100, the inputunit 167, and the external server which support various communicationmethods and the transmission/reception method is not limited toBluetooth.

When copy information is completely transmitted to the external server(not shown), the controller may complete outputting of visual, haptic,and auditory feedbacks provided by the portable apparatus 100.

When the residual size of the memory of the input unit 167 issufficient, copy information is transmitted to the input unit, in stepS608.

When the residual size of the pen memory 550 is larger than a file sizeof the object 711, the controller may perform a control to transmit copyinformation corresponding to the object 711 to the pen communicationunit 520 in a Bluetooth Serial Port Profile (SPP) by using deviceinformation of the input unit 167. The copy information may includeobject data, a file name, a file size, a file type, a file storagelocation, and a copy time period.

When copy information is completely transmitted to the input unit 167,the controller may output visual, haptic, and auditory feedbacksprovided by the portable apparatus 100.

Returning to step S604 of FIG. 6, when a copy command is not input via abutton of the input unit 167, it is determined whether a touch gestureof the input unit is detected, in step S609.

When a touch gesture (for example, a rotation, a flick, or a long press)by the input unit 167 is detected from the touch screen 190, thecontroller may detect a continuous movement (for example, continuous Xand Y coordinates corresponding to a movement of the touch gesture) ofthe touch 712 by using the touch screen 190 and the touch screencontroller 195. The controller may store a continuous movement startingfrom the detected touch 712 in the storage. The continuous movement ofthe touch 712 means that a contact on the touch screen is continued. Forexample, a long press may refer not to a continuous movement of a touchbut to a touch gesture whose touch maintenance time period is 2 s ormore.

When a touch gesture (for example, a rotation, a flick, or a long press)of the input unit 167 which is hovering is input to the touch screen190, the controller may detect a continuous movement (for example,continuous X and Y coordinates corresponding to a movement of the touchgesture) of the input unit 167 by using the pen recognition panel 191and the touch screen controller. The controller may store a continuousmovement starting from the detected hovering location in the storage.

It will be easily understood by those skilled in the art that a touchgesture may be changed through setting of an environment in step S609 ofFIG. 6.

When a touch gesture of the input unit 167 is not detected in step S609of FIG. 6, the methodology terminates.

When a touch gesture of the input unit 167 is detected, a copy icon isdisplayed, in step S610.

Referring to FIG. 7H, the controller may display an icon group 720 inresponse to an input touch gesture. The icon group 720 includes a copyicon 720 a, a cut icon 720 b, and a delete icon 720 c. It will be easilyunderstood by those skilled in the art that the icon displayed in theicon group 720 may be added, changed, or deleted to correspond to aperformance or structure of the portable apparatus 100.

In step S611 of FIG. 6, a copy command is received by selection of acopy icon.

Referring to FIG. 7I, the copy icon 720 a is selected 721 from thedisplayed icon group 720 by the input unit 167. The controller receivesa copy command corresponding to the selection 721 of the copy icon 720 aby the input unit 167. The controller maps the received copy commandwith device information of the input unit 167 stored in advance to storethe mapping result in the storage. When the copy icon 720 a is selected,the controller may perform a control to remove the icon group 720.

The controller may perform a control to transmit a mode conversionsignal of the input unit corresponding to the input copy command to theinput unit. The pen controller 510 converts an operation mode of theinput unit 167 into a copy mode in response to the received modeconversion signal. When the button 542 is pressed by the user, the pencontroller 510 may release a copy mode, which is an operation mode ofthe input unit 167.

When the copy icon 720 a is selected by the input unit 167 that ishovering, the controller may perform a control to transmit a modeconversion signal of the input unit corresponding to the input copycommand to the input unit. The pen controller 510 converts an operationmode of the input unit 167 into a copy mode in response to the receivedmode conversion signal. When the button 542 is pressed by the user, thepen controller 510 may release a copy mode, which is an operation modeof the input unit 167.

When a copy command is received via selection of the copy icon 720 a,the continues at step S605.

FIG. 9 is a flowchart illustrating a feedback providing method of aportable apparatus, according to an embodiment of the present invention.

FIGS. 10A to 10G illustrate feedback providing methods of a portableapparatus, according to various embodiments of the present invention.

FIG. 11 shows an example of haptic waveforms of a portable apparatus,according to an embodiment of the present invention.

In step S901 of FIG. 9, a second touch of the input unit 167 isdetected.

Referring to FIG. 10A, the note application screen 720 is touched by theinput unit 167. The controller 110 may detect a second touch 1012 of theinput unit 167 from the note application screen 720 through the touchscreen 190, the pen recognition panel 191, and the touch screencontroller 195. The controller 110 may receive third locationinformation (for example, X3 and Y3 coordinates) corresponding to thesecond touch 1012 from the touch screen controller 195.

Hovering 1012 a of the input unit 167 is detected in the noteapplication screen 720. The controller may detect hovering 1012 a of theinput unit 167 from the note application screen 720 through the penrecognition panel 191 and the touch screen controller. The controllermay receive fourth location information (for example, X4 and Y4coordinates) corresponding to hovering 1012 a detected from the touchscreen controller.

The controller may store touch information (for example, a touchpressure or a hovering height) corresponding to a touch on the touchscreen 190 included in the received third location information or ahovering touch, a touch detection time, and a touch on the touch screen190 included in the fourth location information in the storage. Thetouch 1012 contacting the touch screen 190 may be generated, forexample, by one of fingers or the input unit 167.

It will be easily understood by those skilled in the art that the numberof detected touches may be changed to correspond to a performance orstructure of the portable apparatus 100.

The controller 110 may receive device information (for example, a modelname, a unique unit ID, a residual size of a memory, a Bluetoothversion, or a Bluetooth profile) from the input unit 167. The controller110 may receive copy information (for example, object data, a file name,a file size, a file type, a file storage location, and a copy timeperiod) from the input unit 167. When copy information exists in theinput unit 167, the controller 110 may receive copy information from theinput unit. The received device information and copy information may bestored in the storage. The controller 110 may perform various examplesof the present invention by using the device information of the inputunit 167.

In step S902 of FIG. 9, a paste location is selected.

Referring to FIG. 10A, the controller 110 may select a paste locationcorresponding to the touch 1012 of the input unit 167. The controller110 may select a paste location corresponding to hovering 1012 a of theinput unit 167. The controller 110 may select a paste location by usingthird location information (X3 and Y3 coordinates) corresponding totouch 1012 of the input unit 167 received from the touch screencontroller 195, and fourth location information (X4 and Y4 coordinates)corresponding to hovering 1012 a. The controller 110 may map deviceinformation of the input unit 167 stored in advance with third locationinformation or fourth location information to store the mapping resultin a temporary storage space or clip board in the note application 720.The controller 110 may provide at least one of visual feedback (forexample, a flash, and a video) through the touch screen 190, auditoryfeedback (for example, output of a sound) using the speaker 163, andhaptic feedback (for example, output of vibrations) using the vibrationmotor 164 in correspondence to selection of a paste location.

The controller 110 may perform a control to transmit a second controlsignal corresponding to haptic feedback (for example, output ofvibrations) to be output from the pen vibrating element 544 in aBluetooth Serial Port Profile (SPP) through a communication unit inresponse to device information of the input unit 167 stored in advanceand selection of a paste location. The input unit 167 may output hapticfeedback from the pen vibrating element 544 based on a second controlsignal received from the portable apparatus 100.

The controller 110 may perform a control to transmit a second controlsignal corresponding to haptic feedback and a second control signalcorresponding to auditory feedback (for example, output of a sound) tobe output from the pen speaker 543 in response to device information ofthe input unit 167 separately stored in advance and selection of a pastelocation to the input unit in a Bluetooth SPP through a communicationunit. The input unit 167 may output auditory feedback (for example,output of a sound) from the pen speaker 543 based on the second controlsignal received from the portable terminal 100. The pen controller 510may provide one of haptic feedback and auditory feedback, or provide acombination of haptic feedback and auditory feedback.

The controller may perform a control to transmit a second control signalwhere haptic, auditory, or visual feedback provided by the portableapparatus 100 is the same as haptic, auditory, or visual feedbackprovided by the input unit 167, and/or another control signal through acommunication unit.

In step S903 of FIG. 9, it is determined whether a paste command isreceived via a button of the input unit 167.

Referring to FIG. 10B, the controller 110 may receive a paste command ofthe copied object 711 from the input unit 167 in a BluetoothSPP. Thecontroller 110 maps the received paste command with device informationof the input unit 167 stored in advance to store the mapping result inthe storage. The controller may display an object (711 b in FIG. 7G) ofa predetermined size at a paste location in response to the receivedpaste command.

When the button 542 is pressed 1013 by the user, the pen controller 510converts an operation mode of the input unit 167 into a paste mode. Thepen controller 510 may perform a control to transmit a paste command tothe portable apparatus 100 through the pen communication unit 520. Thepaste command may be transmitted periodically (for example, every 50 ms)for a predetermined time period (for example, 5 s) through the pencommunication unit 520 under the control of the pen controller 510. Thepredetermined time period may be variably regulated. When the button 542is pressed once more by the user, the pen controller 510 may release apaste mode, which is a current operation mode of the input unit 167.When the button 542 of an input unit 167 that is hovering is pressed1013 by the user, the pen controller 510 may convert an operation modeof the input unit 167 into a paste mode. If an input is generated bytouching the button 542, when the button 542 is of a button type, thepen controller 510 may convert an operation mode of the input unit 167into a paste mode. The pen controller 510 may perform a control totransmit a paste command to the portable apparatus 100 in a BluetoothSPP through the pen communication unit 520. The paste command may betransmitted periodically (for example, every 50 ms) for a predeterminedtime period (for example, 5 s) through the pen communication unit 520under the control of the pen controller 510. When the button 542 ispressed once more by the user, the pen controller 510 may release thepaste mode, which is a current operation mode of the input unit 167.

When it is determined that a paste command is received in step S903 ofFIG. 9, visual feedback is displayed on the touch screen and a controlcommand corresponding to haptic feedback is transmitted to the inputunit, in step S904.

Referring to FIGS. 10C and 10D, the controller displays visual feedback1014 for expanding the object 711 b of a predetermined size to an object1011 in response to the received paste command. The visual feedback 1014expands the object 1011 to an original size (for example, 200 pixels×240pixels) with reference to a third touch location. The visual feedback1014 gradually expands from the predetermined size 711 b of the objectto an original size of the object 1011 at a constant rate. Further, thevisual feedback 1014 expands the object with reference to a centrallocation of the paste location.

The controller 110 may perform a control to transmit a second controlsignal to the input unit 167 in a Bluetooth SPP by using deviceinformation of the input unit 167 stored in advance in response to thereceived paste instruction. The second control signal may include hapticinformation on haptic feedback 1015 to be output through the penvibrating element 544. The second control signal may include auditoryinformation on auditory feedback 1016 to be output through the penspeaker 543. The auditory information may include a sound source outputthrough the pen speaker 543. The input unit 167 may store auditoryinformation corresponding to haptic information corresponding to hapticfeedback, and auditory information corresponding to auditory feedback inthe pen memory 550 in advance. The control information may include afile name, a file type, pen speaker activation information, soundintensity information, and pen speaker deactivation informationcorresponding to a sound source stored in the pen memory 550.

The controller may simultaneously perform transmission of a secondcontrol signal to the input unit 167 and displaying of visual feedback,or may perform one of transmission of a second control signal anddisplaying of a visual feedback first.

According to an embodiment of the present invention, additional visualfeedback 1014 a using a new object 1014 b may be selectively provided.Referring to FIG. 10D, when the visual feedback 1014 is displayed, thenew object 1014 b is displayed adjacent to the object 711 b. The newobject 1014 b is a full pipette that has suctioned a liquid. Thecontroller may display the pipette 1014 b, which gradually decreases inliquid content in response to the visual feedback 1014 by which the sizeof the object 711 b is gradually expanded to a predetermined size. Whenthe object 1011 is completely expanded to a predetermined size, thecontroller 110 may display an empty pipette 1014 c, which no liquid. Thecontroller may display the pipette 1014 c for a predetermined timeperiod (for example, 500 ms).

The controller 110 may perform a control to output haptic feedbackthrough the vibration motor 164 as well as through visual feedback inresponse to the received copy command. The controller 110 may vibratethe vibration motor 164 to correspond to haptic information as shown inFIG. 11 to provide a haptic feedback. FIG. 11 is described in greaterdetail below with respect in step S905 of FIG. 9. The controller 110 mayperform a control to output a sound source corresponding to auditoryfeedback through the speaker 163 as well as visual feedback in responseto the received copy command.

In step S905 of FIG. 9, the input unit provides haptic feedback andauditory feedback.

Referring to FIGS. 10C and 11, the pen controller 510 may receive acontrol command in a Bluetooth SPP through the pen communication unit520. The pen controller 510 may control such that the pen vibratingelement 544 outputs haptic feedback corresponding to haptic informationincluded in control information in response to the received controlcommand.

The transverse axis (X axis) of FIG. 11 represents a vibration timeperiod of the vibrating element 544, in units of 50 ms 1105 a. Thelongitudinal axis (Y axis) represents a vibration intensity of thevibrating element 544, in units of 500 mV 1105 b. It can be seen thatthe haptic waveform corresponding to the haptic information of FIG. 11rapidly increases from 0 V to 1.3 V and gradually decreases to 0V in thevibration.

In a preprocessing section 1110 a, the pen controller 510 may analyzeand/or store control information received by the portable apparatus 100and supply electric power to the pen vibrating element 544. For example,the preprocessing section 1110 a may refer to a section beforevibrations are generated in the pen vibrating element 544.

An acceleration section 1110 b refers to a section in which a vibrationtime period and a vibration intensity of the pen vibrating element 544increase. A maximum intensity 1110 d of the acceleration section 1110 bmay be changed according to a file size and a copy processing timeperiod included in the copy information. For example, the maximumacceleration section and the maximum intensity of the accelerationsection whose file size is 1 MB may be greater than those of theacceleration section whose file size is 500 KB. The copy processing timeperiod and the maximum intensity of the acceleration section whose copyprocessing time period is 1.5 s may be greater than those of theacceleration section whose copy processing time period is 500 ms.

A deceleration section 810 c refers to a section in which vibrations ofthe pen vibrating element 544 corresponding to the maximum intensity1110 d decelerate. The pen controller 510 may complete outputting ofhaptic feedback in the deceleration section 1110 c. The time axis of thedeceleration section 1110 c may be shorter than or equal to the timeaxis (X axis) of the acceleration section 810 b. In an embodiment of thepresent invention, various haptic waveforms (for example, FIGS. 13 to15) whose vibration time periods, vibration periods, vibrationintensities are different may be stored in addition to FIG. 11, andanother haptic waveform may be generated and stored by using acombination of the haptic waveforms (for example, FIGS. 13 to 15) thatare stored in advance.

The pen controller 510 may perform a control to output auditory feedbackcorresponding to auditory information (for example, a sound source)included in control information, from the pen speaker 543, in responseto the received control command. The pen controller 510 may perform acontrol to selectively output one of haptic feedback and auditoryfeedback.

In step S906 of FIG. 9, it is determined whether copy informationincluding object data exists in the memory of the input unit.

The controller 110 may identify existence of copy information includingobject data in the pen memory 550 of the input unit 167 by using deviceinformation and copy information of the input unit 167 stored inadvance.

According to the result of the determination, the controller 110 mayrequest copy information including object data from the input unit 167by using device information. In an embodiment of the present invention,it will be easily understood by those skilled in the art that theidentification of copy information including object data may beperformed in steps S901 to S904.

When it is determined that copy information including object data existsin the pen memory of the input unit in step S906, copy informationincluding object data is received from the input unit, in step S907.

The controller 110 may perform a control to request and receive copyinformation including object data from the pen communication unit 520 ofthe input unit 167 in a Bluetooth SPP. The copy information may includeobject data, a file name, a file size, a file type, a file storagelocation, and a copy time period. The controller 110 stores copyinformation including the received object data in the storage. When copyinformation including object data is received from the input unit 167,the controller 110 may complete outputting of visual, haptic, andauditory feedback provided from the portable apparatus 100.

In step S908 of FIG. 9, an object is displayed.

Referring to FIG. 10E, the controller 110 displays the object 1011 byusing the received copy information. Two identical objects are displayedon the application screens 710 and 720 of the touch screen.

Returning to step S903 of FIG. 9, when a paste command is not receivedvia a button of the input unit 167, it is determined whether a touchgesture of the input unit is detected, in step S909.

When a touch gesture of the input unit is not detected in step S909 ofFIG. 9, the methodology terminates.

When a touch gesture (for example, a rotation, a flick, or a long press)by the input unit 167 is detected from the touch screen 190, thecontroller 110 may detect a continuous movement (for example, continuousX and Y coordinates corresponding to a movement of the touch gesture)(not shown) of the touch 1012 by using the touch screen 190 and thetouch screen controller 195. The controller 110 may store a continuousmovement starting from the detected touch 1012 in the storage. Thecontinuous movement of the touch 1012 means that a contact on the touchscreen is continued. For example, a long press may refer not to acontinuous movement of a touch, but to a touch gesture whose touchmaintenance time period is 2 s or more.

When a touch gesture of the input unit 167, which is hovering, is inputto the touch screen 190, the controller may detect a continuous movementby using the pen recognition panel 191 and the touch screen controller.The controller may store a continuous movement starting from thedetected hovering location in the storage.

It will be easily understood by those skilled in the art that a touchgesture may be changed through setting of an environment in step S909 ofFIG. 9.

When a touch gesture of the input unit is detected in step S909 of FIG.9, a copy icon is displayed, in step S910.

Referring to FIG. 10F, the controller may display a paste icon 1020 inresponse to an input touch gesture. It will be easily understood bythose skilled in the art that the icon displayed in response to thetouch gesture may be added, changed, or deleted to correspond to aperformance or structure of the portable apparatus 100.

In step S911 of FIG. 9, a paste command is received via selection of thepaste icon.

Referring to FIG. 10G, the paste icon 1020 is selected by the input unit167. The controller 110 receives a paste command corresponding to theselection of the paste icon 1020 by the input unit 167. The controller110 maps the received paste command with device information of the inputunit 167 stored in advance to store the mapping result in the storage.When the paste icon 1020 is selected, the controller may perform acontrol not to display the icon group 720.

The controller 110 may perform a control to transmit a mode conversionsignal of the input unit 167 corresponding to the input paste command tothe input unit. The pen controller 510 converts an operation mode of theinput unit 167 into a paste mode in response to the received modeconversion signal. When the button 542 is pressed by the user, the pencontroller 510 may release a paste mode, which is an operation mode ofthe input unit 167.

When a paste icon 1020 is selected by the input unit 167 that ishovering, the controller 110 may perform a control to transmit a modeconversion signal of the input unit 167 corresponding to the input pastecommand to the input unit. The pen controller 510 converts an operationmode of the input unit 167 into a paste mode in response to the receivedmode conversion signal. When the button 542 is pressed by the user, thepen controller 510 may release a paste mode, which is an operation modeof the input unit 167.

When a paste command is input by selection of the paste icon in stepS911 of FIG. 9, the methodology continues to step S904.

Returning to step S906 of FIG. 9, when copy information including objectdata does not exist in the memory of the input unit, copy information isreceived from an external server, in step S912.

The controller 110 may perform a control to request and receive firstcopy information without object data from the pen communication unit 520of the input unit 167 in a Bluetooth SPP. The controller 110 may performa control to request and receive a download of object data stored in anexternal server from the external server by using copy informationstored in the storage in advance, an URL of the external server, and acommunication unit.

It will be easily understood by those skilled in the art that in thepresent invention, a copy command, control information, and copyinformation are transmitted and received between the portable apparatus100, the input unit 167, and the external server by using communicationunits of the portable apparatus 100, the input unit 167, and theexternal server which support various communication methods and thetransmission/reception method is not limited to the Bluetooth.

The controller 110 may store object data received from an externalserver and first copy information received from the input unit in thestorage. When object data is completely received from an external serverand first copy information is completely received from the input unit167, the controller may complete outputting of visual, haptic, andauditory feedbacks provided by the portable apparatus 100.

In step S912 of FIG. 9, when copy information is received from anexternal server and the input unit, step S908 is performed.

FIG. 12 is a diagram illustrating a feedback providing method of aportable apparatus, according to an embodiment of the present invention.

Referring to FIG. 12, this method is a feedback providing methodprovided between a plurality of portable terminals.

Referring to FIG. 12, feedback corresponding to a copy & paste actionusing the input unit 167 may be provided between a plurality of portableapparatuses 101 and 102. When a residual size of a memory of the inputunit 167 is sufficient, a controller of a first portable apparatus 101may transmit control information corresponding to the object 711selected by the input unit 167 and copy information including objectdata to the input unit 167 in a Bluetooth SPP. A controller of a secondportable apparatus 102 can recognize that the input unit 167 has copyinformation through discovery and pairing with the input unit 167. Thecontroller of the second portable apparatus 102 may receive controlinformation and copy information from the input unit 167 in a BluetoothSPP to correspond to a paste command of the input unit 167.

When the residual size of the memory of the input unit 167 is notsufficient, the controller of the first portable apparatus 101 maytransmit control information corresponding to the object 711 selected bythe input unit 167 and first copy information excluding object data tothe input unit 167 in a Bluetooth Serial Port Profile (SPP). Thecontroller of the first portable apparatus 101 may transmit object datato an external server through a communication unit. The controller ofthe first portable apparatus 101 may transmit object data to the secondportable apparatus 102 through a communication unit.

The controller of the second portable apparatus 102 can recognize thatthe input unit 167 has copy information through discovery and paringwith the input unit 167. The controller of the second portable apparatus102 may receive control information and first copy information from theinput unit 167 in a Bluetooth SPP to correspond to a paste command ofthe input unit 167. The controller of the second portable apparatus 102may receive object data from an external server through a communicationunit. The controller of the second portable apparatus 101 may receiveobject data from the first portable apparatus 101 through acommunication unit.

The feedback providing method between a plurality of portableapparatuses is substantially the same as the feedback providing method(for example, selection of an object to be copied,transmission/reception of a copy command corresponding to a copy of anobject, selection of haptic feedback, a control command, copyinformation, and a paste location, transmission and reception of a pastecommand corresponding to a paste of an object, haptic feedback, acontrol command, and copy information) of one portable apparatus.

FIGS. 13 to 15 show examples of haptic waveforms of a portableapparatus, according to embodiments of the present invention.

Referring to FIGS. 8 and 11, it can be seen that haptic waveforms ofFIGS. 13 to 15 are periodically repeated a plurality of times. Thetransverse axis of FIGS. 13 to 15 represents a vibration time of thevibrating element 544, in units of 50 ms. The longitudinal axis of FIGS.13 to 15 represents a vibration intensity of the vibrating element 544,in units of 500 mV.

The haptic waveform of FIG. 13 is a repeated vibration whose intensitygradually increases from 0 V to 800 mV, gradually decreases, and thenincreases again. The acceleration section and the deceleration sectionof FIG. 13 are symmetrical.

The haptic waveform of FIG. 14 is a repeated vibration whose intensitygradually increases from 0 V to 900 mV, rapidly decreases to 500 mV,gradually decreases to 200 mV, and then increases again.

The haptic waveform of FIG. 15 is a repeated vibration whose intensitygradually increases from 0 V to 950 mV, rapidly decreases to 100 mV, andthen increases again.

It will be easily understood by those skilled in the art that in anembodiment of the present invention, in addition to FIGS. 13 to 15,various haptic waveforms having different vibration time periods,vibration periods, and vibration intensities may be stored and otherhaptic waveforms may be generated and stored through a combination ofthe various haptic waveforms that are stored in advance.

It will be appreciated that embodiments can be realized in the form ofhardware, software or a combination of hardware and software. Inparticular, methods according to certain embodiments can be realized inthe form of program instructions, which are executable through variouscomputer units and can be recorded in a computer readable medium. Thecomputer readable medium can include a program instruction, a data file,and a data structure alone or through a combination thereof. The programinstruction recorded in the medium can be specifically designed forembodiments of the present invention or are well known to those skilledin the field of computer software.

Any such software may be stored in the form of volatile or non-volatilestorage, for example a storage device like a ROM, whether erasable orrewritable or not, or in the form of memory, for example RAM, memorychips, device or integrated circuits or on an optically or magneticallyreadable medium, for example a CD, DVD, magnetic disk or magnetic tapeor the like. It will be appreciated that the storage devices and storagemedia are embodiments of machine-readable storage that are suitable forstoring a program or programs comprising instructions that, whenexecuted, implement embodiments of the present invention.

Accordingly, certain embodiments provide a program comprising code forimplementing apparatus or a method as claimed in any one of the claimsof this specification and a machine-readable storage storing such aprogram. Still further, such programs may be conveyed electronically viaany medium, for example a communication signal carried over a wired orwireless connection and embodiments suitably encompass the same.

While the invention has been shown and described with reference tocertain embodiments thereof, it will be understood by those skilled inthe art that various changes in form and detail may be made thereinwithout departing from the spirit and scope of the invention as definedby the appended claims.

Features, integers or characteristics described in conjunction with aparticular aspect, embodiment or example of the invention are to beunderstood to be applicable to any other aspect, embodiment or exampledescribed herein unless incompatible therewith.

It will be also be appreciated that, throughout the description andclaims of this specification, language in the general form of “X for Y”(where Y is some action, activity or step and X is some means forcarrying out that action, activity or step) encompasses means X adaptedor arranged specifically, but not exclusively, to do Y.

What is claimed is:
 1. A method for providing feedback of a portableapparatus, the method comprising: displaying at least one object on atouch screen of the portable apparatus; detecting a first touch, from aninput unit, at a position on the touch screen corresponding to thedisplayed object; selecting the object in response to the first touch;receiving, from the input unit, a copy command by which the selectedobject is copied to a copy target; and transmitting, from the portableapparatus to the input unit, a first control command corresponding tohaptic feedback determined in response to the received copy command. 2.The method of claim 1, wherein the first touch comprises hovering of theinput unit.
 3. The method of claim 1, further comprising: displayingvisual feedback corresponding to the copy command on the touch screen,wherein the visual feedback is provided using at least one of theselected object and a new object adjacent to the selected object.
 4. Themethod of claim 3, wherein the visual feedback using the selected objectcomprises transitioning an original size of the selected object to apredetermined smaller size at a constant rate, and moving the selectedobject with the smaller size to a location where a touch of the inputunit is detected.
 5. The method of claim 3, wherein the new objectcomprises a pipette, the visual feedback using the new object comprisessuctioning a liquid into the pipette, and a time period during which thepipette is displayed is determined based on one of a file sizecorresponding to the selected object and a copy processing time period.6. The method of claim 1, further comprising: transmitting copyinformation corresponding to the copy command from the portableapparatus to at least one of the input unit and an external server,wherein the copy information comprises information of at least two typesselected from of object data, a file name, a file size, a file type, afile storage location, and a copy time period corresponding to theselected object.
 7. The method of claim 6, further comprising:receiving, from the input unit, device information of the input unit;wherein the copy information is transmitted to at least one of the inputunit and the external server based on the device information.
 8. Themethod of claim 7, wherein some of the copy information is transmittedto the input unit based on the device information, and remaining copyinformation is transmitted to the external server based on the deviceinformation.
 9. The method of claim 1, wherein the copy command isprovided via one of a button of the input unit and a touch gesture ofthe input unit.
 10. The method of claim 9, wherein a selectable copyicon, corresponding to execution of a copy of the selected object, isdisplayed adjacent to the selected object in response to the touchgesture of the input unit.
 11. The method of claim 1, furthercomprising: detecting a second touch, from the input unit, on the touchscreen; selecting a paste location where the copied object is to bepasted based on a location of the second touch; receiving, from theinput unit, a paste command by which the copied object is to be pastedat the paste location; transmitting a second control commandcorresponding to haptic feedback determined in response to the receivedpaste command to the input unit; and displaying the copied object at thepaste location.
 12. The method of claim 11, wherein the second touch ofthe input unit comprises hovering of the input unit.
 13. The method ofclaim 11, further comprising: displaying visual feedback correspondingto the paste command on the touch screen.
 14. The method of claim 13,wherein the visual feedback comprises transitioning the predeterminedsmaller size of the selected object to the original size at a constantrate, moving the selected object to the selected paste location.
 15. Themethod of claim 13, wherein the visual feedback comprises visualfeedback of a new object, which comprises decreasing an amount of liquidin a pipette, and a time period during which the pipette is displayed isbased on one of a file size corresponding to the copied object and apaste processing time period.
 16. The method of claim 11, furthercomprising: receiving copy information corresponding to the pastecommand from one of the input unit and an external server, wherein thecopy information comprises at least two of object data, a file name, afile size, a file type, a file storage location, and a copy time periodcorresponding to the object to be copied.
 17. The method of claim 16,further comprising: receiving, from the input unit, device informationof the input unit; wherein the copy information is received from atleast one of the input unit and the external server based on the deviceinformation.
 18. The method of claim 17, wherein some of the copyinformation is received from the input unit based on the deviceinformation, and remaining copy information is received from theexternal server based on the device information.
 19. The method of claim11, wherein the paste command is provided via one of a button of theinput unit and a touch gesture of the input unit.
 20. The method ofclaim 19, wherein a selectable paste icon, corresponding to execution ofa paste of the object to be copied, is displayed adjacent to the objectto be copied in response to the touch gesture of the input unit.
 21. Aportable apparatus comprising: a touch screen that displays at least oneobject; a communication unit that communicates with an input unit; and acontroller that controls the touch screen and the communication unit,wherein the controller performs a control to select the object inresponse to a first touch, from the input unit, at a position on thetouch screen corresponding to the displayed object, and to transmit afirst control signal to the input unit through the communication unit,the first control signal corresponding to haptic feedback determined inresponse to a copy command received from the input unit for copying theobject to a copy target.
 22. The portable apparatus of claim 21, whereinthe controller performs a control to display visual feedbackcorresponding to the copy command on the touch screen.
 23. The portableapparatus of claim 21, wherein the controller performs a control tooutput auditory feedback corresponding to the copy command from aspeaker of the portable apparatus.
 24. The portable apparatus of claim21, wherein the controller performs a control to receive deviceinformation of the input unit, from the input unit through thecommunication unit, and to transmit at least some of copy informationcorresponding to the copy command from the communication unit to theinput unit based on the device information.
 25. The portable apparatusof claim 21, wherein the controller performs a control to select a pastelocation where the copied object is pasted in response to a second touchfrom the input unit on the touch screen, and to transmit a secondcontrol signal to the input unit through the communication unit, thesecond control signal corresponding to haptic feedback determined inresponse to a paste command for pasting the copied object received fromthe input unit.
 26. The portable apparatus of claim 25, wherein thecontroller performs a control to output at least one of visual feedbackof the touch screen and auditory feedback of a speaker in response tothe paste command.
 27. A method for controlling feedback of an inputunit, the method comprising: transmitting a copy command for copying anobject selected from a touch screen of the portable apparatus, from theinput unit to the portable apparatus; receiving a first control signalcorresponding to the copy command from the portable apparatus; andoutputting haptic feedback corresponding to the received first controlsignal through a pen vibrating element of the input unit.
 28. The methodof claim 27, further comprising: outputting auditory feedbackcorresponding to the received control signal through a pen speaker ofthe input unit.
 29. The method of claim 27, further comprising:transmitting a paste command for pasting the copied object at a pastelocation on the touch screen of the portable apparatus, from the inputunit to the portable apparatus; receiving a second control signalcorresponding to the paste command from the portable apparatus; andoutputting haptic feedback and auditory feedback corresponding to thereceived second control signal.
 30. An input unit comprising: a penvibrating element; a pen communication unit that communicates with aportable apparatus; and a controller that controls the pen vibratingelement and the pen communication unit, wherein the controller performsa control to transmit a copy command for copying an object selected froma touch screen of the portable apparatus to the portable apparatusthrough the pen communication unit, and to output haptic feedbackcorresponding to a first control signal received from the portableapparatus through the pen communication unit, through the pen vibratingelement.
 31. The input unit of claim 30, further comprising: a penspeaker, wherein the controller performs a control to output auditoryfeedback corresponding to the first control signal through the penspeaker.
 32. The input unit of claim 30, wherein the controller performsa control to transmit a paste command for pasting the copied object at apaste location on the touch screen of the portable apparatus to theportable apparatus through the pen communication unit, and to outputhaptic feedback and auditory feedback corresponding to a second controlsignal corresponding to the paste command received from the portableapparatus.